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Abstract 

We study the local complete synchronization of discrete-time dynamical 
networks with time-varying couplings. Our conditions for the temporal vari- 
ation of the couplings are rather general and include both variations in the 
network structure and in the reaction dynamics; the reactions could, for ex- 
ample, be driven by a random dynamical system. A basic tool is the concept of 
Hajnal diameter which we extend to infinite Jacobian matrix sequences. The 
Hajnal diameter can be used to verify synchronization and we show that it is 
equivalent to other quantities which have been extended to time- varying cases, 
such as the projection radius, projection Lyapunov exponents, and transverse 
Lyapunov exponents. Furthermore, these results are used to investigate the 
synchronization problem in coupled map networks with time- varying topologies 
and possibly directed and weighted edges. In this case, the Hajnal diameter 
of the infinite coupling matrices can be used to measure the synchronizability 
of the network process. As we show, the network is capable of synchronizing 
some chaotic map if and only if there exists an integer T > such that for any 
time interval of length T, there exists a vertex which can access other vertices 
by directed paths in that time interval. 

Key Words: Synchronization, dynamical networks, time-varying coupling, Ha- 
jnal diameter, projection joint spectral radius, Lyapunov exponents, spanning tree. 
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1 Introduction 



Synchronization of dynamical processes on networks is presently an active research 
topic. It represents a mathematical framework that on the one hand can elucidate 
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- desired or undesired - synchronization phenomena in diverse applications. On 
the other hand, the synchronization paradigm is formulated in such a manner that 
powerful mathematical techniques from dynamical systems and graph theory can 
be utilized. A standard version is 

x\t + l)=fix\t),x\t),--- ,x"'{t)), i = l,2,... ,m, (1) 

where t € Z+ = {0, 1,2, •••} denotes the discrete time, € M denotes the 

state variable of unit (veretex) i, and for i = 1,2, •• • ,m, /* : ^ R is a 
function. This dynamical systems formulation contains two aspects. One of them 
is the reaction dynamics at each node or vertex of the network. The other one 
is the coupling structure, that is, whether and how strongly, the dynamics at one 
node is directly influenced by the states of the other nodes. 

Equation (1) clearly is an abstraction and simplification of synchronization prob- 
lems found in applications. On the basis of understanding the dynamics of (1), 
research should then move on to more realistic scenarios. Therefore, in the present 
work, we address the question of synchronization when the right hand side of (1) is 
allowed to vary in time. Thus, not only the dynamics itself is a temporal process, 
but also the underlying structure changes in time, albeit in some applications that 
may occur on a slower time scale. 

The essence of the hypotheses on / = [/^, • • • , /™] needed for synchronization 
results (to be stated in precise terms shortly) is that synchronization is possible 
as an invariant state, that is, when the dynamics starts on the diagonal [x, • • • ,x], 
it will stay there, and that this diagonal possesses a stable attracting state. The 
question about synchronization then is whether this state is also attracting for 
dynamical states [x^,--- outside the diagonal, at least locally, that is when 
the components are not necessarily equal, but close to each other. This can be 
translated into a question about transverse Lyapunov exponents, and one typically 
concludes that the existence of a synchronized attractor in the sense of Milnor. 
In our contribution, we can already strengthen this result by concluding (under 
appropriate assumptions) the existence of a synchronized attractor in the strong 
sense instead of only in the weaker sense of Milnor. (We shall call this local complete 
synchronization.) This comes about because we achieve a reformulation of the 
synchronization problem in terms of Hajnal diameters (a concept to be explained 
below). 

Our work, however, goes beyond that. As already indicated, our main contri- 
bution is that we can study the local complete synchronization of general coupled 
networks with time-varying coupling functions, in which each unit is dynamically 
evolving according to 

x\t + l) = flix\t),x\t),---,x"'it)), i = l,2,.--,m. (2) 

This formulation, in fact, covers both aspects described above, the reaction dynam- 
ics as well as the coupling structure. The main purpose of the present paper then 
is to identify general conditions under which we can prove synchronization of the 
dynamics (2). Thus, we can handle variations of the reaction dynamics as well as 
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of the underlying network topology. We shall mention below various applications 
where this is of interest. 

Before that, however, we state our technical hypothesis on the right hand side 
of (2): for each t G Z+, /j : R'" ^ R is a C"^ function with the following hypothesis: 

Hi. There exists a function f{s) : M — > R such that 

fiis,sr-- ,s) = f{s) 

holds for a// s G R, i G Z"^, and i = 1, 2, • • • , m. Moreover, for any compact set 
K C R™ fl and the Jacobian matrices [d fl / dx^YP^^^ are all equicontinuous in K 
with respect to t & Z"*" and the latter are all nonsingular in K . 

This hypothesis ensures that the diagonal synchronization manifold 

S = i^[x^,x^,--- G R"* : x' = x^, i,j = 1,2,--- ,m| 

is an invariant manifold for the evolution (2). If x^{t) = x'^it) = ■ ■ ■ = = s{t) 

denotes the synchronized state, then 

s{t + l) = f{s{t)). (3) 

For the synchronized state (3), we assume the existence of an attractor: 

H2. There exists a compact asymptotically stable attractor A for Eq. (3). That 
is, (i) A <Z is a forward invariant set; (ii) for any neighborhood U of A there 
exists a neighborhood V of A such that f^iV) C U for all n G Z"*"; (Hi) for any 
sufficiently small neighborhood U of A, f^{U) converges to A, in the sense that for 
any neighborhood V, there exists uq such that f"'{U) C V for n > uq; (iv) there 
exists s* & A for which the uj-limit set is A. 

Let denote the Cartesian product A x ■ ■ ■ x A (m times) . Local complete 
synchronization (synchronization for simplicity) is defined in the sense that the set 
S n A^ = {[x, - ■ ■ ,x] : X G A} is an asymptotically stable attractor in R™. That is, 
for the coupled dynamical system (2), differences between components converge to 
zero if the initial states are picked sufficiently near S H A™, i.e., if the components 
are all close to the attractor A and if their differences are sufficiently small. In order 
to show such a synchronization, one needs a third hypothesis H3 that in technical 
terms is about Lyapunov exponents transverse to the diagonal. That is, while the 
dynamics on the attractor may well be expanding (the attractor might be chaotic), 
the transverse directions need to be suitably contracting to ensure synchronization. 
The corresponding hypothesis H3 will be stated below (see (29)) because it requires 
the introduction of crucial technical concepts. 

It is an important aspect of our work that we shall derive the attractivity here in 
the classical sense, and not in the sense of Milnor, i.e., not only some set of positive 
measure, but a full neighborhood is attracted. For details about the difference 
between Milnor attractors and asymptotically stable attractors; see [1,2]. Usually, 
when studying synchronization, one derives only the existence of a Milnor attractor; 
see [3]. 
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The motivation for studying (2) comes from the weU-known coupled map lattices 
(CML) [4], which can be written as follows: 

m 

x\t + l) = f{x\t)) + Y,U,f{x'{t)). i = l,2,...,m, (4) 
i=i 

where / : M — > M is a differentiable map and L = [Lij]^-^^ S j^m.xm jg ^j^g diffusion 
matrix, which is determined by the topological structure of the network and satisfies 
Lij > for all i ^ j, and YlJLi^ij = for all i = 1,2, ••• ,m. Letting x = 
[x\x^,...,x'^]'^ GM™', F{x) = e M™', and G = /„, + ^, 

where Im denotes the identity matrix of dimension m, the CML (4) can be written 
in the matrix form 

x(t + l) = GF{x{t)) (5) 

where G = [Gij]'^j^i £ ]K»^x™ denotes the coupling and satisfies Gij > for i 7^ j 
and "^JLi Gij = 1 for alH = 1, 2, • • • , m. So, if Ga > holds for all i = 1, 2, • • • , m, 
then G is a stochastic matrix. 

Recently, synchronization of CML has attracted increasing attention [3,5-8]. 
Linear stability analysis of the synchronization manifold was proposed and trans- 
verse Lyapunov exponents were used to analyze the influence of the topological 
structure of networks. In [1], conditions for generalized transverse stability were 
presented. If the transverse (normal) Lyapunov exponents are negative, a chaotic 
attractor on an invariant submanifold can be asymptotically stable over the mani- 
fold. Ref. [9,10] have found out that chaos synchronization in a network of nonlinear 
continuous-time or discrete-time dynamical systems respectively is possible if and 
only if the corresponding graph has a spanning tree. However, synchronization 
analysis has so far been limited to autonomous systems, where the interactions 
between the vertices (state components) are static and do not vary through time. 

In the social, natural, and engineering real-world, the topology of the network 
often varies through time. In communication networks, for example, one must 
consider dynamical networks of moving agents. Since the agents are moving, some 
of the existing connections can fail simply due to occurrence of an obstacle between 
agents. Also, some new connections may be created when one agent enters the 
effective region of other agents [11]. On top of that, randomness may also occur. In 
a communication network, the information channel of two agents at each time may 
be random [12]. When an error occurs at some time, the connections in the system 
will vary. In [11-13], synchronization of multi-agent networks was considered where 
the state of each vertex is adapted according to the states of its connected neighbors 
with switching connecting topologies. This multi-agent dynamical network can be 
written in discrete-time form as 

771 

x\t + l) = J2Gij{t)x^{t), i = l,2,--- ,m, (6) 

i=i 

where x^{t) G M is the state variable of vertex j and [Gij{t)]'^j^i, t E Z"*", are 
stochastic matrices. Ref. [14] considered a convexity-conserving coupling function 
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which is equivalent to the linear coupling function in (6). It was found that the con- 
nectivity of the switching graphs plays a key role in the synchronization of multi- 
agent networks with switching topologies. Also, in the recent literature [15-17], 
synchronization of continuous-time dynamical networks with time-varying topolo- 
gies was studied. The time-varying couplings investigated, however, are specific, 
with either symmetry [15], node balance [16], or fixed time average [17]. 

Therefore, it is natural to investigate the synchronization of CML with general 
time-varying connections as: 



x{t + l) = G{t)F{x{t)) 



(7) 



where G{t) = [Gij{t)]^j^-^^ e j^mxm (;|gi^Qt;gg couphng matrix at time t and 
F{x) = [/(xi), • • • , f{xn)]^ is a differentiable function. We shall address this prob- 
lem in the context of the general coupled system (2). 
Let 



x{t) 



x\t) 
x\t) 



and Ft{x{t)) 



x'^it) 

Eq. (2) can be rewritten in a matrix form: 

x{t + I) = Ft{x{t)) 



,x^it)) 
,x^{t)) 



(8) 



The time- varying coupling can have a special form and may be driven by some 
other dynamical system. Let y = {il, JF, P, ^(*)} denote a metric dynamical system 
(MDS), where is the metric state space, J-" is the cj-algebra, P is the probability 
measure, and 6l(*) is a semiflow satisfying = o and 6^^^ = id, where id 

denotes the identity map. Then, the coupled system can be regarded as a random 
dynamical system (RDS) driven by 3^: 

x{t + 1) = F{x{t), 6'(*)a;), t G Z+, u e Q. (9) 

In fact, one can regard the dynamical system (9) as a skew product semiflow, 

G : Z+ X J] X M™ ^ X 
GW(a;,x) = (0(*)L<j,x(t)). 

Furthermore, the coupled system can have the form 

x{t + 1) = F{x{t), u{t)), t G Z+, (10) 

where u belongs to some function class lA and may be interpreted as an external 
input or force. Then, defining [0^*V](r) = u{t -|- r) as a shift map, the system (10) 
has the form of (9). In this paper, we first investigate the general time- varying case 
of the system (8) and also apply our results to systems of the form (9). 
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To study synchronization of the system (8), we use its variational equation by 
hnearizing it. Consider the difference 6x^{t) = x^{t) — /^*~*°^(so)- This implies that 
6x^{t) — 6x^{t) = x^{t) — x^{t) holds for all i, j = 1, 2, • • • , m. We have 



5x\t + tQ) 



E 



t+tp-l ( r(t-l) 



dx^ 



(f^^-^)(so))6x^t + to-l), i 



where for simplicity we have used the notation — ^q"!^"^ {f^^~^\^o)) to denote 



1,2,- 



, m. 



(11) 



dfl 



dxi 



9.F^if^'~'\so),--- J^'~'\so)). Let 

6x^t) 

6x{t) 



Dtis) 



dxi 



6x"\t) 

The variational equation (11) is written in matrix form, 

6x{t + to) = Dt+to^i{f^'~^\so))6x{t + to - 1 



(12) 



For the Jacobian matrix, the following lemma is an immediate consequence of 
the hypothesis Hi. 



Lemma 1 



J=l J 



, s) = f'{s), i = 1,2, ■ ■ ■ ,m and t G Z"*". 



Namely, all rows of the Jacobian matrix [dfl/dxj]Y^j^^ evaluated on the synchro- 
nization manifold <S have the same sum, which is equal to f'{s). 

As a special case, if the time variation is driven by some dynamical system 
y = {fi, J-', P, }, then the variational system does not depend on the initial time 
to, but only on {sq,ijj). Thus, the Jacobian matrix can be written in the form 
D{f^^\sQ), O^^^uj) = Dt{f^^\s)), by which the variational system can be written as: 



6x{t + 1) = D{f^^\so),9^^^u)6x{t). 



(13) 



In this paper, we first extend the concept of Hajnal diameter to general matrices. 
A matrix with Hajnal diameter less than one has the property of compressing 
the convex hull of {x^,--- ,x"^}. Consequently, for an infinite sequence of time- 
varying Jacobian matrices, the average compression rate can be used to verify 
synchronization. Since the Jacobian matrices have identical row sums, the (skew) 
projection along the diagonal synchronization direction can be used to define the 
projection joint spectral radius, which equals the Hajnal diameter. Furthermore, 
we show that the Hajnal diameter is equal to the largest Lyapunov exponent along 
directions transverse to the synchronization manifold; hence, it can also be used to 
determine whether the coupled system (2) can be synchronized. 
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Secondly, we apply these results to discuss the synchronization of the CML 
with time-varying couplings. As we shall show, the Hajnal diameter of infinite 
coupling stochastic matrices can be utilized to measure the synchronizability of 
the coupling process. More precisely, the coupled system (7) synchronizes if the 
sum of the logarithm of the Hajnal diameter and the largest Lyapunov exponent 
of the uncoupled system is negative. Using the equivalence of the Hajnal diameter, 
projection joint spectral radius, and transverse Lyapunov exponents, we study some 
particular examples for which the Hajnal diameter can be computed, including 
static coupling, a finite coupling set, and a multiplicative ergodic stochastic matrix 
process. We also present numerical examples to illustrate our theoretical results. 

The connection structure of the CML (5) naturally gives rise to a graph, where 
each unit can be regarded as a vertex. Hence, we associate the coupling matrix G 
with a graph F = {V,E), with the vertex set V = {1,2, . . . ,m} and the edge set 
E = {cij}, where there exists a directed edge from vertex j to vertex i if and only 
if Gij > 0. The graphs we consider here are assumed to be simple (that is, without 
loops and multiple edges), but are allowed to be directed and weighted. That is, 
we do not assume a symmetric coupling scheme. 

We extend this idea to an infinite graph sequence {r(t)}. That is, we regard 
a time-varying graph as a graph process {rit)}tez+ ■ Define T{t) = [V,E{t)] where 
V = {1,2, ••• ,m} denotes the vertex set and E{t) = {eij{t)} denotes the edge 
set of the graph at time t. The time-varying coupling matrix G{t) might then be 
regarded as a function of the time-varying graph sequence, i.e., G{t) = G{T{t)). 
A basic problem that arises is, which kind of sequence can ensure the synchrony 
of the coupled system for some chaotic synchronized state s{t -|- 1) = f{s{t)). As 
we shall show, the property that the union of the r(i) contains a spanning tree is 
important for synchronizing chaotic maps. We prove that under certain conditions, 
the coupling graph process can synchronize some chaotic maps, if and only if there 
exists an integer T > such that there exists at least one vertex j from which any 
other vertex can be accessible within a time interval of length T. 

This paper is organized as follows. In Section 2, we present some definitions 
and lemmas on the Hajnal diameter, projection joint spectral radius, projection 
Lyapunov exponents, and transverse Lyapunov exponents for generalized Jacobian 
matrix sequences as well as stochastic matrix sequences. In Section 3, we study 
the synchronization of the generalized coupled discrete-time systems with time- 
varying couplings (2). In Section 4, we discuss the synchronization of the CML with 
time-varying couplings (7) and study the relation between synchronizability and 
coupling graph process topologies. In addition, we present some examples where 
synchronizability is analytically computable. In Section 5, we present numerical 
examples to illustrate the theoretical results, and conclude the paper in Section 6. 

2 Preliminaries 

In this section we present some definitions and lemmas on matrix sequences. First, 
we extend the definitions of the Hajnal diameter and the projection joint spectral 
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radius, introduced in [18-20] for stochastic matrices, to generaUzed time-varying 
matrix sequence. Furthermore, we extend Lyapunov exponents and projection 
Lyapunov exponents to the general time-varying case and discuss their relation. 
Secondly, we specialize these definitions to stochastic matrix sequences and intro- 
duce the relation between a stochastic matrix sequence and graph topology. 

2.1 General definitions 

We study the following generalized time-varying linear system 

u{t + to + l) = Lt+to{Q^'\(t>))u{t + to), (14) 

where g^^^ is defined by a random dynamical system {^,B,P, g^^^}, where ^ denotes 
the state space, B the cr-algebra on <I>, P the probability measure, g^^^ a semiflow. 
Studying the linear system (14) comes from the variational system of the coupled 
system (2). For the variational system (12), g^^\-) represents the synchronized state 
flow f^^\-). And, if Lj(-) is independent of t, then the linear system (14) can be 
rewritten as: 

u(t + l) = L(^W(0))n(t). (15) 

Thus, it can represent the variational system (13) as a special case, where g^^^ is 
the product flow {f^^\-),0^^\-)). Hence, the linear system (14) can unify the two 
cases of variational systems (12,13) of the coupled system (2,9). 

For this purpose, we define a generalized matrix sequence map £ from x ^ 
to 2^* 

(to,^) ^ {Lt+to{Q'-'U)}t&+- (16) 

where 2''^'"^'" denotes the set containing all subsets of M'"^™'. In [18,19], the con- 
cept of the Hajnal diameter was introduced to describe the compression rate of a 
stochastic matrix. We extend it to general matrices below. 

Definition 1 For a matrix L with row vectors 51, • • • ,gm o,nd a vector norm \\ ■ \\ 
in , the Hajnal diameter of L is defined by 

diam(L, || • ||) = max \\gi - gj\\. 

We also introduce the Hajnal diameter for a matrix sequence map C 

Definition 2 For a generalized matrix sequence map C, the Hajnal diameter of C 
at (p £ ^ is defined by 




where Y\ denotes the left matrix product: YVk^i Ak = An x An-i x • • • x 
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The Hajnal diameter for the infinite matrix sequence map £ does not depend 
on the choice of the norm. In fact, all norms in a Euclidean space are equivalent 
and any additional factor is eliminated by the power \/t and the limit as t — > oo. 

Let 7i C M™^™ be a class of matrices having the property that all row sums are 
the same. Thus, all matrices in Ti. share the common eigenvector eo = [1, 1, • • • , 1]^, 
where the corresponding eigenvalue is the row sum of the matrix. Then, the pro- 
jection joint spectral radius can be defined for a generalized matrix sequence map 

similar to introduced in [20] as follows. 

Definition 3 Suppose C{to, (p) C TC for tQ € and Let Sq be the subspace 

spanned by the synchronization direction eo = [1, 1, • • • , l]"*", and P be any (m — 
1) X m matrix with exact kernel Sq. We denote by L ^ i^(™--i)x(™-i) ^/jg (^skew) 
projection of matrix L as the unique solution of 

PL = LP. (17) 

The projection joint spectral radius of the generalized matrix sequence map C is 
defined as 



p{£,((>) = lim sup 



n ^k{g^ 



k=to 



One can see that p{C, (p) is independent of the choice of the matrix norm || • || 
induced by vector norm. The following lemma shows that it is also independent of 
the choice of the matrix P. 

Lemma 2 Suppose C{tQ,(j)) C Ti for all to > and G <I>. Then 

p{C, 4>) = diam(£, cj)). 

A proof is given in the Appendix. 

The Lyapunov exponents are often used to study evolution of the dynamics [5,6]. 
Here, we extend the definitions of Lyapunov exponents to general time-varying 
cases. 

Definition 4 For the coupled system (2), the Lyapunov exponent of the matrix 
sequence map C initiated by (p ^ ^ in the direction u € M™ is defined as 



A(£,(A,n) =lh^r-suplog|| 17 LkiQ^^~'<'U)u\\. (18) 

The projection along the synchronization direction cq can also define a Lyapunov 
exponent, called the projection Lyapunov exponent: 

, t+to-l 

X{C,^,v)=J^-snplog\\ n Lk{g^^-'^U)v\\, (19) 

where Lk{Q^(l)) is the projection of matrix Lk{g^4>) as defined in Definition 3. 
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It can be seen that the definition of the generahzed Lyapunov exponent above 
satisfies the basic properties of Lyapunov exponents^. For more details about gen- 
eralized Lyapunov exponents, we refer to [23]. 

Lemma 3 Suppose C{tQ,(f)) C Ti. for all (j) ^ ^ and tQ > 0. Then, 
sup A(jC, (j), v) = log p{C, (j)) = log diam(>C, (^). 

A proof is given in the Appendix. 

This lemma implies that the projection joint spectral radius gives the largest 
Lyapunov exponent in directions transverse to the synchronization direction eo of 
the matrix sequence map C 

When the time dependence arises from being totally driven by some random 
dynamical system, we can write the generalized matrix sequence map C as C{<j)) = 
{L(^(*)(/))}jg2+ since it is independent of to and is just a map on <I>. As introduced 
in [24], we have specific definitions for Lyapunov exponents of the time- varying 
system (15) as follows. 

For the linear system (15), the Lyapunov exponent of the matrix sequence map 
C initiated by € <I> in the direction u G M™ is defined as 



\{C,(t),u) 



-1 



lim — log 

t—*oo t 



t-1 



k=0 



(20) 



If C{(f)) C Ti. for all (p G ^, then the Lyapunov exponent in the synchronization 
direction eo is 

1 t-i 

A(/:,0,eo) = lim-logV|c(A;)|, (21) 

t^oo t ^ — ' 
fc=0 

where c{k) denotes the corresponding common row sum at each time k. The pro- 
jection along the synchronization direction eo can also define a Lyapunov exponent, 
called the projection Lyapunov exponent: 

t-i 



lim — log 

t— >oo t 



k=0 



(22) 



where L{q^u>) is the (skew) projection of matrix L{q^uj). Also, the Hajnal diameter 
and projection joint spectral radius become 



diam(/:, 4)) = Um <j diam( L(^(*V)) [ , p{C. 



k=0 



lim 



i-1 



fc=0 



According to Lemmas 2 and 3, log diam(£, cp) = log p{C, (p) = sup^,gjjm-i ,^.^0 ^(^> ''^)- 
Let Ao be the Lyapunov exponent along the synchronization direction eo and Ai, 
A21 ■ ■ ■ 5 Am-i be the remaining Lyapunov exponents for the initial condition (j), 
counted with multiplicities. 



^This kind of definition of characteristic exponent is similar to the Bohl exponent used to study 
uniform stability of time- varying systems in [22]. 
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Lemma 4 Suppose that C{(f)) C TC is time-independent. Let the matrix D(t) = 
[Dij{t)]Y^j^i denote the matrix L{Q^^'>cj)) and c{t) denote the corresponding common 
row sum of D{t). If the following hold 



1. lim l/tEfe=olog|c(A:)| = Ao, 

t — >oo 



2. lim 1/t log^ \Dij{t)\ < 0, for alii, j = 1,2, - ■ ■ ,m, where log"''(2;) = maxjlog z, 0}, 



t—fCO 

then 



log diam(>C, (j)) = log p{£., (j)) = sup Aj 

i>l 



A proof is given in the Appendix. 

Using the concept of Hajnal diameter, we can define (uniform) synchronization 
of the non-autonomous system (2) as follows: 

Definition 5 The coupled system (2) is said to he (uniformly locally completely) 
synchronized if there exists rj > such that for any e > 0, there exists T > such 
that the inequality 

diam([xi(t),a;2(t),... ,x'^{t)]'^) <e (23) 

holds for all t > to + T, to > and x*(to); ^ = Ij 2, • • • , m in the r] neighborhood of 
s(to) of a synchronized state s(t). 

2.2 Stochastic matrix sequences 

The above definitions can also be used to deal with stochastic matrix sequences. 

Definition 6 A matrix G S ]^"ixm ^^^^^ ^ stochastic matrix if its elements 

are nonnegative and each row sum is 1. 

We here consider the general time-varying case without the assumption of an 
underlying random dynamical system and write a stochastic matrix sequence as 
G = {G'(t)}jg2+. The case that the time variation is driven by some dynamical 
system can be regarded as a special one. 

Definition 7 The Hajnal diameter of Q is defined as 

/ to+t-i . 1 

diam(^) = lim sup ( diam TT G{k)] (24) 

and the projection joint spectral radius for Q is 

to+t-l 



n G{k) 

k=ta 



p{Q) = lim sup 
where G{t) is the projection of G{t), as in Definition 3. 



(25) 
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Then, from Lemma 2, we have 

Lemma 5 diam(t?) = p{G)- 

To esthnate the Hajnal diameter of a product of stochastic matrices, we use the 
concept of scrambhng introduced in [20]. 

Definition 8 A stochastic matrix G = [Gjj]^-^;^ € M™^™ is said to he scrambling 
if for any i,j, there exists an index k such that Gik 7^ and Gjk 7^ 0. 

For gi = [gi^i, • • • , gi^rn] € M™ and gj = [gj^i, ■■■ , gj^rn] G K"*, define 

giAgj = [min(5ri,i,gj-i), • • • ,inm{gi^rn, gj,m)]- 

We use the following quantity introduced in [18, 19] to measure scramblingness, 

V{G) = min||5(i Afi-jlli, 

where, || • ||i is the norm given by |[x||i = 1^*1 ^ — [^i' ' ' ' T^m] € M™. It 

is clear that < 77(G) < 1, and that ??(G) > if and only if G is scrambling. Thus, 
the well-known Hajnal inequality has the following generalized form. 

Lemma 6 ( Generalized Hajnal inequality, Theorem 6 in [20].) For any vector 
norm in and any two stochastic matrices G and H , 

diam{GH) < (1 - 7?(G))diam(i7). (26) 

The concepts of projection joint spectral radius and Hajnal diameter are linked 
to the ergodicity of stochastic matrix sequences. We can extend the ergodicity for 
a matrix set [20,28] to a matrix sequence as follows: 

Definition 9 (Ergodicity, Definition 1 in [14]-) A stochastic matrix sequence E = 
{G(t)}tg2+ is said to be ergodic if for any to and e > 0, there exists T > such 
that for any t > T and some norm \\ • \\, 

/to+t-l \ 

diam JJ G(s) < e. (27) 
V s=to / 

Moreover, if for any e > 0, there exists T > such that inequality (27) holds for 
all t >T and to >0, Q is said to be uniformly ergodic. 

A stochastic matrix G = [Gij]'!^j^i can be associated with a graph T = [V,E], 
where V = {1,2, ••• ,m} denotes the vertex set and E = {cij} the edge set, in 
the sense that there exists an edge from vertex j to i if and only if Gij > 0. Let 
Fi = [V, El] and F = [V, E2] be two simple graphs with the same vertex set. We also 
define the union Fi |J F2 = [F, -Bi |J -£^2] (merging multiple edges). It can be seen 
that for two stochastic matrices Gi and G2 with the same dimension and positive 
diagonal elements, the edge set of Fi |J F2 is contained in that of the corresponding 
graph of the product matrix G1G2. In this way, we can define the union of the graph 
sequence {F(t)}jg2+ across the time interval [ti, t2] by IJfcLt ^(A;) = [V, UlLt ^ik)]- 
The following concepts for graphs can be found, e.g., in [25]. 
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Definition 10 A graph T is said to have a spanning tree if there exists a vertex, 
called the root, such that for each other vertex j there exists at least one directed 
path from the root to vertex j . 

It follows that {r(t)}(g2+ has a spanning tree across the time interval [ti,t2] if 
the union of {^it)}tez+ across [ii, has a spanning tree. This is equivalent to the 
existence of a vertex from which all other vertices can be accessible across [ii,t2]- 

Definition 11 A graph T is said to be scrambling if for any different vertices i and 
j, there exists a vertex k such that there exist edges from k to i and from k to j. 

It follows that a stochastic matrix G is scrambling if and only if the correspond- 
ing graph r is scrambling. 

Lemma 7 (See Lemma 4 [^^]-) G{1),G{2), ■ ■ ■ ,G{m — 1) be stochastic 
matrices with positive diagonal elements, where each of the corresponding graphs 
T(l), T{2), ■ • • , r(m — 1) have spanning trees. Then YYk=i G{k) is scrambling. 

Suppose now that the stochastic matrix sequence Q is driven by some metric 
dynamical system y = {^1,, P,9^^^}. We write Q as {G{t) = G{9^^^Lo)}t^i+ , where 
uj € Q. Then, as stated in Section 2.1, we can define the Lyapunov exponents. 

Definition 12 The Lyapunov exponent of the stochastic matrix sequence Q is de- 
fined as 



For a given w G 0, one can see that diam(C/) and p{Q) both equal the largest 
Lyapunov exponent of Q in directions transverse to the synchronization direction 
under several mild conditions. 

In closing this section, we list some notations to be used in the remainder of 
the paper. The matrix L denotes the (skew) projection of the matrix L along the 
vector e introduced in Definition 3, and C is the (skew) projection of the matrix 
sequence map C along e. For x = {x^,--- ,x'^)^ € M"^, the average ^YllLi^^ 
of X is denoted by x. The notation || • || denotes some vector norm in the linear 
space M*", and also the matrix norm in M™^'" induced by this vector norm. /^*^(so) 
denotes the t- iteration of the map / with initial condition sq- We let x{t,tQ,XQ) be 
the solution of the coupled system (2) with initial condition xito) = xq, which we 
sometimes abbreviate as x{t). 



a 




The projection Lyapunov exponents is defined as 




where G{-) is the projection of G{-) as defined in Definition 3. 
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3 Generalized synchronization analysis 

For the variational system (12), similar to the Subsection 2.1, we denote by T> the 
Jacobian sequence map in the generalized sense, i.e., P is a map from Z"*" x M 
to 2l«'"''": V{to,So) = {Dt+to{f^'Hso))}teZ+ C H for ah to € Z+ and So G A. 
Furthermore, letting 

t+to-l 

Bit,to)= n Dk{f^'~''H^o)), 

k=to 

we can rewrite the variational system (12) as follows: 

5x{t + to) = Dt+to~i{f^'~^\so))6xit + to-l) = Bit,to)5x{to). (28) 
From Definitions 2 and 3, we have 

diam(P,so) = lh^rsup<^diam( FT Dk{f^^-''>\so))) 

n ^fc(/^'^-*«Hso)) 

fe=io 



piV, So) = lim sup 

*"*°oto>0 



We will also refer to the following hypothesis. 
Hs. 



sup diam(P,so) < 1- (29) 



Theorem 1 // hypotheses H1-H3 hold, then the compact set A"^ f]S is a uni- 
formly asymptotically stable attractor of the coupled system (2) in W^, i.e., the 
coupled system (2) is uniformly locally completely synchronized. 



Proof. Let 

diam(P,io,t,so) =diamf J] I)fc(/('^-*»)(so)) ) , 



k=to 

diam(P,t,so) = sup { diam( TT Dk{f^^-'''\so))) \. 

According to H3, letting 1 > d > sup^^^g^ diam(P, sq) and no satisfy d"" < |, 
for any so £ A, there exists n(so) > no such that diam(X', t, sq) < d holds for 
all t > n{so). By equicontinuity (Hi) and compactness (H2), there must exist a 
finite integer set V = {ni, n2, • ■ ■ , n^} satisfying ni > no for all i = 1, 2, • • • ,v and 
a neighborhood [/ of A such that for any so G U, there exists G V such that 

diam(nfc=t"'"^^fc(/^''"*°Hso))) < t^"^ < 5 holds for ah to > 0. 
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By the hypothesis H2, there exists a compact neighborhood of A such that 
[/ D D A, f{W) C W, and f] = ^ [26]. Let 

n>0 

a = min 

where d/f (•, •) denotes the Hausdorff metric in M . Then, define a compact set 
Wa = \ x = (x\ • • • .x"") G M™ : max Ix* - x\ < a and x eW}. 

[ l<i<m J 

By the mean value theorem, we have 

fi{x\k), . • • , x^{k)) - f{s{k), • . . , s{k)) = -J^^iei), 

where ^ belongs to the closed interval induced by the two ends x*(A;) and s{k). 
Denote by Dk{ik) the matrix [d fUCi) / dx%^^. 

Let a > be sufficiently small so that for each xq E Wa with s(to) = xq and 
x(to) = 2:0, there exists ti G V such that 

|x*(ti,to,xo)-/(*^-*»nSo)|<| 

n < 2 

holds for all to > 0. Then, for any xq € W^, xq S VF, we have 

ti+to-l 

5x{ti + to) = n Dk{^ik))5xQ = B{ti, to)5xo, 

k=to 

where B{ti,to) = Uk=!o~^ Dkim)- Then, 

|<5x^(ti+to)-fe^(ti+to)| < J^|Bifc(ti,to) -5jfc(ti,to)||fe^ol 

fc=i 

< diam(i?(ti, to)) max |xq — xo|. 

l<j<m 

Thus, we conclude that 

max |x*(ti + to) — x-'(ti + to)| < - max |xq — x^|. 

By the definition of Wa, we see that x(ti + to) S Wa/2- With initial time to + ti, 
we can continue this phase and afterwards obtain 

lim jx^t) -x^(t)| = 0, i,j = 1,2,--- ,m, 

t—Kxy 
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uniformly with respect to to € ^^nd xq € Wa- Therefore, the coupled system 
(2) is uniformly synchronized. Furthermore, we obtain that yl™ P| 5 is a uniformly 
asymptotically stable attractor for the coupled system (2) and the convergence rate 
can be estimated by ©({sup^^^g^ diam(X', So)}*) since d is chosen arbitrarily greater 
than supggg^ diam(P, So)- The theorem is proved. 

Remark 1. The idea of the above proof comes from that of Theorem 2.12 in [1], 
with a modification for the time-varying case. In Theorem 2.12 in [1], the authors 
used normal Lyapunov exponents to prove asymptotical stability of the original 
autonomous system for the case when it is asymptotically stable in an invariant 
manifold. In this paper, we directly use the Hajnal diameter of the left product 
of the infinite Jacobian matrix sequence map to measure the transverse differences 
of the collections of spatial states. Furthermore, we consider a non-autonomous 
system here due to time- varying couplings. 

Following Lemma 2 gives 

Corollary 1 // sup^^g^ /5(X', sq) < 1, then the coupled system (2) is uniformly 
synchronized. 

Consider the special case that the coupled system (9) is a RDS on a MDS 
y = {^l,!F,P,9^*^}. We can write this coupled system (9) as a product dynamical 
system {A x O,F,P,0^*)}, where F is the product c-algebra on A x Q, P denotes 
the probability measure, and eW(so,u;) = (6lWa;, /W(so)). Let D{f^^\so),d^^^oj) 
denote the Jacobian matrix at time t. By Definition 4, the Lyapunov exponents for 
the coupled system (9) can be written as follows: 



A(u, So, oj) = lim - log 

t-^QO t 



1 



A,'=0 



It can be seen that the Lyapunov exponent along the diagonal synchronization 
direction cq is 



1 

A(eo,so,u;) = lim - log |c(A;)|, 



k=0 

where c{k) is the common row sum of D{f^''\sQ),9^''^uj). Let Ao = A(eo,so,u;), 
Ai, • • • , Am-i be the Lyapunov exponents (counting multiplicity) of the dynamical 
system C with the initial condition (sqjUj). From Lemma 4, we conclude that 
supj>i Aj = log p{F, so,Lo) = log diam(F, sq, w). If the probability P is ergodic, then 
the Lyapunov exponents exist for almost all sq (z A and a; G and furthermore 
they are independent of {so,uj). 

Corollary 2 Suppose that hypotheses H1-H2 and the assumptions in Lemma 4 
hold. Suppose further that A x il. is compact in the weak topology defined in this 
RDS, the semiflow 0^*^ is continuous, the Jacobian matrix D{-, •) is non-singular 
and continuous on A x and 

sup sup Ai < 0, 

PGErge(Axn) i>l 
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where Erg@(A x 0) denotes the ergodic probability measure set supported in {A x 
f2,F,0(*)}. Then the coupled system (9) is uniformly locally completely synchro- 
nized. 



Proof. By Theorem 2.8 in [1], we have 



-1 



sup Amax(2^,P)= sup Hm - log 



fc=0 



where V is the projection of the intrinsic matrix sequence map V and Aniax(i^i P) 
denotes the largest Lyapunov exponent of T> according to the ergodic probability 
P (the value for all almost {so,uj) according to P). From Lemmas 2, 3 and 4, it 
follows 

sup SUpAj = sup Amax(^',P)= SUp Aniax(^, ^0, t^) 

PeErge(AxQ) i>l PGErgQ(Axr2) {so,w)GAxn 

= sup log /)(P, f^) = sup log diam.{'D, So, uj). 

The corollary is proved as a direct consequence from Theorem 1. 

Remark 2. If Aq is the largest Lyapunov exponent, then V = {u : X{u) < Aq} 
constructs a subspace of which is transverse to the synchronization direction cq . 
Corollary 2 implies that if all Lyapunov exponents in the transverse directions are 
negative, then the coupled system (2) is synchronized. Otherwise, if Aq is not the 
largest Lyapunov exponent, then supj>i Aj < implies that the largest exponent is 
negative, which means that the synchronized solution s{t) is itself asymptotically 
stable through the evolution (9). 

Remark 3. From Lemma 4, it can also be seen that when computing p{T>), it is 
sufficient to compute the largest Lyapunov exponent of V. In [1], the authors proved 
for an autonomous dynamical system that if all Lyapunov exponent of the normal 
directions, namely, the Lyapunov exponents for T) are negative, then the attractor in 
the invariant submanifold is an attractor in M"* (or a more general manifold). In this 
paper, we extend the proof theorem 2.12 in [1] to the general time- varying coupled 
system (2) by discussing the relation between the Hajnal diameter and transverse 
Lyapunov exponents. In the following sections, we continue the synchronization 
analysis for non-autonomous dynamical systems. 

4 Synchronization analysis of coupled map lattices with 
time- varying topologies 

Consider the following coupled system with time-varying topologies: 

m 

x\t + I) = Y,Gij{t)f{x^{t)),i = 1,2,- ■■ ,m, tGZ+, (30) 
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where /(•) : M ^ M is continuous and G{t) = [Gy(t)]^. is a stochastic matrix. 
In matrix form, 

x{t + l) = G{t)Fix{t)). (31) 

Since the couphng matrix G{t) is a stochastic matrix, the diagonal synchronization 
manifold is invariant and we have the uncoupled (or synchronized) state as: 

s{t + l) = f{s{t)). (32) 

We suppose that for the synchronized state (32), there exists an asymptotically 
stable attractor A with the (maximum) Lyapunov exponent 



1 

IJ,= sup lim- Vlog|/'(s(fc))|. 



fc=0 

The system (30) is a special form of (2) satisfying the equicontinuous condition 
Hi. Linearizing the system (30) about the synchronized state yields the variational 
equation 

m 

Sx'{t + l) = ^G^j{t)f'{s{t))Sx\t), i = l,2,.- - ,m, 



diam n G(A;)/'(/('=-*°)(so)) =diam J] Gik)) Hfif^'Hso)) 



and 

•io+i-l \ yto+t-1 

\ 

k=to ^ ^ k=to ' «=0 

Denote the stochastic matrix sequence {G(t)}t£2+ by Q. Thus, the Hajnal diameter 
of the variational system is diam(^)e^. Using Theorem 1, we have the following 
result. 



Theorem 2 Suppose that the uncoupled system s{t + 1) = f(s{t)) satisfies hypoth- 
esis H2 with Lyapunov exponent fi. Let Q = {G{t)}i^i+ . If 

diam(g)e'' < 1, (33) 

then the coupled system (30) is synchronized. 

From Theorem 2, one can see that the quantity diam(t/) as well as other equiv- 
alent quantities such as the projection joint spectral radius and the Lyapunov ex- 
ponent, can be used to measure the synchronizability of the time- varying coupling, 
i.e., the coupling stochastic matrix sequence Q. A smaller value of diam(^) implies 
a better synchronizability of the time- varying coupling topology. If the uncoupled 
system (32) is chaotic, i.e. /.t > 0, then the necessary condition for synchroniza- 
tion condition (33) is diam(^) < 1. So, it is important to investigate under what 
conditions diam(^) < 1 holds. 
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Suppose that the stochastic matrix set A4 satisfies the following hypotheses: 
H4. A4 is compact and there exists r > such that for any G = [Gij]Y^j^i S M, 

Gij > implies Gij > r and all diagonal elements Gu > r , i = 1,2, ■ ■ ■ ,m. 

We denote the graph sequence corresponding to the stochastic matrix sequence 

Q hy T = {r(t)}jgg+. Then we have the following result. 

Theorem 3 Suppose that the stochastic matrix sequence Q C M satisfies hypoth- 
esis H4. Then, the following statements are equivalent: 



1. diam(g) < 1; 

--to 



2. there exists T > such that for any to, the graph [j^l'^^ l^{k) has a spanning 



tree; 

3. the stochastic matrix sequence Q is uniformly ergodic. 



Proof. We first show (3) (2) by reduction to absurdity. Let B{tQ,t) 
+t-' 
--to 



■Qto+f Since G is uniformly ergodic, there must exist T > such that 



diam(B(to,T)) < 1/2 holds for any to > 0. So, v = G{k)u satisfies: 

max \vi - Vj\ < diam(i?(to,T))||u||oo < -^Hiilloo- (34) 

l<ij'<m Z 

If the second condition does not hold, then there exists tx such that the union 
V}k=tT ^{k) does not have a spanning tree. That is, there exist two vertices vi 
and V2 such that for any vertex z, there is either no directed path from z to vi or 
no directed path from z to V2- Let Ui {U2) be the vertex set which can reach vi 
{v2, respectively) across [tT,tT + T — 1]. This implies that Ui and U2 are disjoint 
across [tT,tT + T — 1] and no edge starts outside of Ui {U2) and ends in Ui {U2) ■ 
Furthermore, considering the Frobenius form of G{t), one can see that the elements 
in the corresponding rows of Ui {U2) with columns associated with outside of Ui 
{U2) are all zeros. Let 

1 i e f/i, 

i(^U2, 
any value in (0, 1), otherwise. 

We have 

[1 i<^Ui, 
[ E [0, 1], otherwise. 
This implies that maxi<jj<m \vi — Vj\ > 1 = \\ 

^11 00 5 which contradicts with (34). 

Therefore, (3) (2) can be concluded. 

We next show (2) =^ (1). Applying Lemma 7, there exists T > such that 
nl^Jt^"^ G(A;) is scrambling for any t^. There exists 5 > such that r]{B{T,tQ)) > 
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5 > for all to > because of the compactness of the set A4. So, 



diam(5(t,to)) 



diam|s(mod(t, T), to + B{T, to + {k - l)T) 



k=l 



< 




^ k=l 



< 



2(1 



(35) 



holds for any to > 0. Here, [t/T] denotes the largest integer less than t/T and 
mod(t, T) denotes the modulus of the division t ^T. Thus, 



This proves (2) =^ (1). Since (1) ^ (3) is clear, the theorem is proved. 

Remark 4. According to Lemma 7, it can be seen that the union of graphs 
across any time interval of length T has a spanning tree if and only if a union of 
graphs across any time interval of length (m — l)r is scrambling. 

Moreover, from [21], we conclude more results on the ergodicity of stochastic 
matrix sequences as follows: 

Proposition 1 The implication (1) (2) =^ (3) holds for the following state- 
ments: 

1. diam(^) < 1; 

2. Q is ergodic; 

3. for any to > 0, the union Ufc>jo ^i^) ^^■^ ^ spanning tree. 

Remark 5. It should be pointed out that the implications in Proposition 1 cannot 
be reversed. Counterexamples can be found in [14]. However, in [14], it is also 
proved under certain conditions that if the stochastic matrices have the property 
that Gij > if and only if Gji > 0, then statement 2 is equivalent to statement 3. 

Assembling Theorem 3, Proposition 1, and the results in [14], it can be shown 
that, for Q C A4, the following implications hold 



regarding the statements: 

• Ai: diam(ty) < 1; 

• A2- there exists T > such that the union across any T- length time interval 
[tQ.to + T]: Ufc^Jt^ r(A;) has a spanning tree; 

• ^3: ^ is uniformly ergodic; 



diam(a) < {I - 6)t < I. 



Ai ^ A2 <^ A3 ^ A4 ^ A5 



20 



• A^: Q is ergodic; 

• A^: for any to, the union across [to, oo): Ufc>jo ^{^) has a spanning tree. 

In the fohowing, we present some special classes of examples of coupled map 
lattices with time- varying couplings. These classes were widely used to describe 
discrete-time networks and studied in some recent papers [5,6,20,21]. The syn- 
chronization criterion for these classes can be verified by numerical methods. Thus, 
the synchronizability diam(t/) of the time-varying couplings can also be computed 
numerically. 

4.1 Static topology 

If G{t) is a static matrix, i.e., G{t) = G, for all t G Z+, then we can write the 
coupled system (30) as 

x{t + l) = GF{x{t)). (36) 



Proposition 2 Let 1 = ctq, o"i, (T2, (Tm.-i be the eigenvalues of G ordered by 
1 > Wi\ > |o'2| > • • • > \am-i\- If < 1, then the coupled system (36) is 

synchronized. 

Proof. Let vq = eo and choose column vectors vi, V2, • ■ ■ , Vm-i in IR*" such that 
vqjVi, - ■ ■ , Vm~i is an orthonormal basis for M™. Let A = [vqjVi, - ■ ■ , Vm-i]- Then, 



A-^GA 



1 a 
G 



where the eigenvalues of G are o"i, ■ ■ ■ , am-i- By the Householder theorem (see 
Theorem 4.2.1 in [34]), for any e > 0, there must exist a norm in M™ such that with 
its induced matrix norm, 

|<7i| < IIGII < |cri| +e. 

Since e is arbitrary, for the static stochastic matrix sequence Go = {G, G, • • • ,}, 
it can be concluded that p{Qo) = |cri|. Using Theorem 2, the conclusion follows. 
Moreover, it can be also obtained that the convergence rate is 0((|(Ti|e'^)*). 

Remark 6. Similar results have been obtained by several papers concerning 
synchronization of coupled map lattices with static connections (see [5,6,8,30]). 
Here, we have proved this result in a different way as a consequence of our main 
result. 

4.2 Finite topology set 

Let Q be a compact stochastic matrix set satisfying H4. Consider the following 
inclusions: 

x{t + l)(£QF{x{t)), (37) 
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I.e., 

x{t + l) = G{t)F{x{t)) (38) 
Git) € Q. (39) 

Then the synchronization of the coupled system (37) can be formulated as follows. 



Definition 13 The coupled inclusion system (37) is said to be synchronized if for 
any stochastic matrix sequence G C Q, the coupled system (38) is synchronized. 

In [20], the authors defined the Hajnal diameter and projection joint spectral 
radius for a compact stochastic matrix set. 

Definition 14 For the stochastic matrix set Q, the Hajnal diameter is given by 

r *-i 

diam(Q) = lim sup < diam( I I G{k)) 
G(fc)eQ I to 

and the projection joint spectral radius is 

p{Q)=i^\ sup iinf5(A:)ii r. 

The following result is from [20]. 
Lemma 8 Suppose Q is a compact set of stochastic matrices. Then, 

diam(Q) = p{Q). 

Using Theorem 2, we have 

Theorem 4 //diam(Q)e^ < 1, then the coupled system (37) is synchronized. 

Moreover, we conclude that the synchronization is uniform with respect to to G 
Z"*" and stochastic matrix sequences Q G Q. Furthermore, we have the following 
result on synchronizability of the stochastic matrix set Q. 

Proposition 3 Let Q be a compact set of stochastic matrices satisfying hypothesis 
H4. Then the following statements are equivalent: 

• Bi: diam(Q) < 1; 

• B2: for any stochastic matrix sequence Q C Q, Q is ergodic; 

• B3: each corresponding graph of a stochastic matrix G ^ Q has a spanning 
tree. 

Proof. The implication Bi ^ B2 ^ B3 is clear by Proposition 1. And S3 =^ Bi 
can be obtained by the proof of Theorem 3 since Q is a finite set of stochastic 
matrices satisfying hypothesis H4. 

Remark 7. By the methods introduced in [31-33], p{Q) can be computed to 
arbitrary precision for a finite set Q despite a large computational complexity. 




22 



4.3 Multiplicative ergodic topology sequence 

Consider the stochastic matrix sequence Q = {G{t)}f^'^+ driven by some dynamical 
system y = i.e., G = {G(^Wu;)} for some continuous map G(-). 

Recah the Lyapunov exponent for Q: 



a{v, Lu) = hm — log 

t-^oo t 

It is clear that o"(eo, w) = for all lo and (t{v, iv) < for all lo and v G M™. So, the 
linear subspace 

= {v,a{v,uj) < 0} 

denotes the directions transverse to the synchronization manifold. If P is an ergodic 
measure for the MDS y, then a{u,uj) and L{uj) are the same for almost all uj with 
respect to P [35]. Then we can let cJi be the largest Lyapunov exponent of G 
transverse to the synchronization direction cq. By Theorem 2 and Corollary 2, we 
have 

Theorem 5 Suppose that 9^^^ is a continuous semiflow, G{-) is continuous on all 
UJ G Q and non-singular, and Q is compact. If 

sup fJi + ^ < 0, 

then the coupled system (30) is synchronized. 

Remark 8. There are many papers discussing the computation of multiplica- 
tive Lyapunov exponents; for example, see [27]. In particular, [36] discussed the 
Lyapunov exponents for the product of infinite matrices. By Lemma 4, we can com- 
pute the largest projection Lyapunov exponent which equals cJi. We will illustrate 
this in the following section. 

5 Numerical illustrations 

In this section, we will numerically illustrate the theoretical results on synchroniza- 
tion of CML with time-varying couplings. In these examples, the coupling matrices 
are driven by random dynamical systems which can be regarded as stochastic pro- 
cesses. Then the projection Lyapunov exponents are be computed numerically by 
the time series of coupling matrices. In this way, we can verify the synchronization 
criterion and analyze synchronizability numerically. Consider the following coupled 
map network with time-varying topology: 

x\t + l) = — i = l,2,---,m, (40) 

E Aik{t) i=i 

k=l 
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Figure 1: Convergence of the second Lyapunov exponent ai for the bhnking topol- 
ogy during the topology evolution with the same recovery time T = 3 and different 
malfunction probability p = 10"^, p = 10"^, and p = 10~^. The initial scale-free 
graph is constructed by the method introduced in [37] with network size 500 and 
average degree 12. 



where x^{t) S M and f{s) = as{l — s) is the logistic map with a = 3.9, which implies 
that the Lyapunov exponent of / is /i « 0.5. The stochastic coupling matrix at 
time t is 



G{t) 



m 



5.1 Blinking scale-free networks 

The blinking scale-free network is a model initiated by a scale-free network and 
evolves with malfunction and recovery. At time t = 0, the initial graph r(0) 
is a scale- free network introduced in [37]. At each time t > 1, every vertex i 
malfunctions with probability p <^ 1. If vertex i malfunctions, all edges linked to it 
disappear. In addition, a malfunctioned vertex recovers after a time interval T and 
then causes the re-establishment of all edges linked to it in the initial graph r(0). 
The coupling Aij{t) = Aji{t) = 1 if vertex j is connected to i at time t; otherwise, 
Aij{t) = Aji{t) = 0, and Aii{t) = 1, for all i, j = 1, 2, • • • ,m. 

In Figure 1, we show the convergence of the second Lyapunov exponent cji 
during the topology evolution with different malfunction probability p. We measure 
synchronization by the variance K = l/(m — 1) < — ^{t))'^ >, where 

< • > denotes the time average, and denote W = ai+ ^. We pick the evolution time 
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Figure 2: Variation of K and W with respect to p for the bhnking topology. 



length to be 1000 and choose initial conditions randomly from the interval (0, 1). 
In Figure 2, we show the variation of K and W with respect to the malfunction 
probability p. It can be seen that the region where W is negative coincides with 
the region of synchronization, i.e., where K is near zero. 



5.2 Blurring directed graph process 

A blurring directed graph process is one where each edge weight is a modified 
Wiener process. In details, the graph process is started with a directed weighted 
graph r(0) of which for each vertex pair (i, j), one of two edges Ajj(O) and ^ji(O) 
is a random variable uniformly distributed between 1 and 2, and the other is zero 
with equal probability, for all i ^ j; Aii{0) = for alH = 1, 2, • • • ,m. At each time 
t > 1, for each Aij{t — 1) 7^ 0, « / j we denote the difference Aij{t) — Aij{t — 1) 
by a Gaussian distribution M{0, r^) which is statistically independent for all i ^ j 
and t S Z"*". If resulted in that Aij{t) is negative, a weight will be added to the 
reversal orientation, i.e., Aji{t) = \Aij{t)\ and Aij(t) = 0. Moreover, if the process 
above results in that there exists some index i such that Aij = holds for all 
j = 1, 2, • ■ ■ , m, then pick Aii{t) = 1. 

In Figure 3, we show the convergence of the second Lyapunov exponent o"i dur- 
ing the topology evolution for different values of the Gaussian distribution variance 
r. Picking r = 0.05, we show the synchronization of the coupled system (40). Let 
K{t) = l/(m — 1) < X^2=i(^*(0 >t, where < ■ >t denotes the time average 

from to t. Since W = ai + fiis about —0.6, i.e. less than zero, the coupled system 
is synchronized. Figure 4 shows in logarithmic scale the convergence of K{t) to 
zero. 
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Figure 3: Convergence of the second Lyapunov exponent o"i for the blurring graph 
process during the topology evolution with Gaussian variance r = 0.5, 0.05, 0.005, 
and the size of the network m = 100. 



time 



Figure 4: Variation of K(t) with respect to time for the blurring graph process. 



26 



6 Conclusion 



In this paper, we have presented a synchronization analysis for discrete-time dy- 
namical networks with time-varying topologies. We have extended the concept of 
the Hajnal diameter to generalized matrix sequences to discuss the synchronization 
of the coupled system. Furthermore, this quantity is equivalent to other widely used 
quantities such as the projection joint spectral radius and transverse Lyapunov ex- 
ponents, which we have also extended to the time-varying case. Thus, these results 
can be used to discuss the synchronization of the CML with time- varying couplings. 
The Hajnal diameter is utilized to describe synchronizability of the time-varying 
couplings and obtain a criterion guaranteeing synchronization. Time- varying cou- 
plings can be regarded as a stochastic matrix sequence associated with a sequence 
of graphs. Synchronizability is tightly related to the topology. As we have shown, 
the statement that diam(^) < 1, i.e. that chaotic synchronization is possible, is 
equivalent to saying that there exists an integer T such that the union of the graphs 
across any time interval of length T has a spanning tree. The methodology will be 
similarly extended to higher dimensional maps elsewhere. 



Appendix 



Proof. (Lemma 2) The proof of this lemma comes from [20] with a minor modi- 
fication. First, we show diam{£., (j)) < p{C,(j)). Let J be any complement of £q in 



with a basis uq, ■ 



-1 such that uq = cq. Let A = [uq, tii, ■ 



_i] which 



is nonsingular. Then, for any t > to and tQ > 0, 



c{t) at 




where c{t) denotes the row sum of Lt{Q^^~^°^ 4>) which is also the eigenvalue corre- 
sponding eigenvector e and Lt{Q^^~^"^ (p) can be the solution of linear equation (17) 
with P composed of the rows of except the first row. For any d > p{C,(l)), 
there exists T > such that the inequality 



n ^k{0 



k=to 



holds for all t > r and to > 0. Let 



to+t-l 



k=to 



(k-to) 



to+t-l 

n c{k) 

k=to 





at 

to+t-l 

n Lfc(£>(^-*«)<^) 

k=to 
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Then, 



k=to 



1 





to+t-1 

k=to 





fc=to 



holds for some constant C > 0. Therefore, 



to+t-l 

S=to 



A 



1 




to+t-l 



to+t-1 

; H c{k),at)A~^ 

k=to 



n ^k{Q 



(fe-io). 



e • q 



k=to 



where g' = [Hfe'rio ^ A ^ and Ci is a positive constant. It says that all row 

vectors of TlfcJio"^ lie inside the CicT neighborhood of q. Hence, 



.to+t-l 

diamf J] Lfc(£)(^-*°)<^) ] <C2d' 



k=to 



for some constant C2 > 0, all t >T, and to ^ 0. This implies that diam(i2, (p) < d. 
Since d is arbitrary, diam(£, (/>) < /)(£, (/>) can be concluded. 

Second, we show that p{C,(l)) < diam{C, cp). For any d > diam{C, cp), there 
exists T > such that 

-to+i-l 



k=to ^ 



holds for alH > T and to > 0. Letting q be the first row of nfc=to~^ Lkig'^^'^''^), 



we have 



to+t-l 



n Lk{Q 



e ■ q 



k=to 



< C.d' 



for some positive constant C3. Let A be defined as above. Then, 

to+t-l 



n Lk{g^'"'''U)A-A-'e-qA 

k=to 



< Cid\ 



I.e., 



to+t-l 

n c{k) 

k=to 





oit 

to+t-l ^ 

fc=to 



7 P 




< C4d* 



< Cd* 
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holds for some 7 and (3. This implies that 



n ^k{Q 



k=to 



holds for all t > T , > and some C5 > 0. Therefore, p{C, 0) < d. The proof is 
completed since d is chosen arbitrarily. 

Proof. (Lemma 3) Let Amax = sup^gjgm-i A(£, v). First, it is easy to see that 
log p{C, (j)) > Amax- We will show log p{C, 0) = Amax- Otherwise, there exists d € 
(exp(Amax)) (j))). By the properties of Lyapunov exponents, for any normalized 
orthogonal basis ui,U2,--- ,Um~i € M'""-'^ with Lyapunov exponent \{C,4>,Ui) = 
Xi, then for any u € M'""-"^ we have X{C, 4>, u) = Aj^, where € {1, 2, - - - , m — 1}. 
p{C, (j)) > d implies that there exist to ^ and a sequence t„ with lim.„^oo tn = +00 
such that 



tn+to — l 

k=to 



for all n > 0. That is, there also exists a sequence Vn € 
that 



pm— 1 



with WVn 



1 such 



k=to 



There exists a subsequence of Vn (still denoted by Vn) with lim^^oo 
5vn = Vn — V* . We have 



w*. Let 



tn+to — i 

n 



> 



n 



k=to 



n 

fc=to 



Note that we can write 5vn = XlilLi ^^n'^i where 6x\ S M with lim^^oo Six\ = 0. 
So, there exists an integer N such that || nArJto""^ Lfc(£i(*^-*o)^)5wn|| < ( E™"i^ I^^D-^*" 
holds for all n > N . Then, we have 



n 

k=to 



for all n > iV and some C > 0. This implies max^gig™ A(£, v) > log (i which con- 
tradicts with the assumption d G (exp(Amax); p('C, 1;/))). Hence, Amax = ^ogp{C,(j)). 

Proof. (Lemma 4) Recalling that {^,B,P,q^^^} denotes a random dynamical 
system, where $ denotes the state space, B denotes the cj-algebra, P denotes the 
probability measure, and g^^^ denotes the semiflow. For a given <^ G <I> we denote 
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LiQ^^U) by L{t). Let A = [ui,U2, 
basis of M"* and ui = e, 



A- 



where ui, - ■ ■ , denotes a 



vi 

Vm. 



is the inverse of A with 

c{t) a^{t) 
L(t) 

Um] e M™x(™-i) and 



=A-^L{t)A 
where = [u2, • ■ ■ > "-m 



= AlD{t)Ai, a^{t) = viL{t)Ai 



Al 



V2 



(m— l)xm 



One can see that the set of Lyapunov exponents of the dynamical system {L{t)}i^z+ 
are the same as those of {L{t)}^^j^+ . For any z{0) = [x{0),y{0)] £ R™ where 
x(0) G R and y{0) £ ]R™-\ this evolution z{t + 1) = L{t)z{t) leads 

c(t - - 1) + a^(t - l)y{t - 1) 
L(t-lMi-l) 



z{t) 
So, we have 



t-1 



fc=o 

l[c{k)x{0) + Y, n c(p)a^(t-fc) n M^MO) 
' " fc=lp=t-fc+l 



k=0 



t-k~l 

n 

9=0 



(41) 

If the upper bound is less than the lower bound for the left matrix product Y\, then 
the product should be the identity matrix. In the following, we denote by C the 
projection sequence map of C and will prove this lemma for two cases. 

Case 1: Aq < log /5(£, i;^). Since p{C, (j)) is just the largest Lyapunov exponent of 
C defined by A, from conditions 1 and 2, one can see that for any e > 0, there exists 
T > such that for any t > T, it holds that \a{t)\ < \\ nfc=o^(^)|| < 6^^+')*, 
and e(^o~')* < 1111=0^(^)1 < e(^o+')*. Thus, we can obtain 
t~i t~i 

n Kp)i=ni^(p)i^ 



1 



k=t-k+l p=0 

„(Ao+e){i) -(Ao-e){i-fc+l) 



n%(p)i 

p=0 



g(Ao+e){t-l) Yl \c{p)\ 

T>q>0 \ p=o 



-1 



k<t-T + l, 
t-l>k>t-T. 
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Then, we have 

t-l t-T+l t-l t~k-l 

\x{t)\ < ll\'^{k)\\xm+ n \c{p)\\a'' (t - k)\ n ll^(5)lllly(0)|| 

fc=0 fc=l p=t-k+l q=0 

t-l t-l t-k-1 

+ E n \cip)\\\a'' {t - k)\\ n ii^(9)iiiiy(o)ii 

k=t-Tp=t~k+l q=0 
t-T+l 

k=l 

t-T+l 

fc=i 

where ^ i g 

Ml = (r+ 1) max^ ( n l^^')!) ^'^(ll ll^(^')ll) 



M2 = 1 + Ml + e~(^o+') E 



„ -3eA; 

fe=l 

So, 



hm - log - 1)11 < A + 4e 

holds for all z(0) S M™. Noting that A must be less than the largest Lyapunov 
exponent of C, we conclude that A is right the largest Lyapunov exponent. This 
implies the conclusion of the lemma. 

Case 2: Aq > A. Noting that for any e G (0, (Aq — A)/3), there exists T such 
that 

t t 

n \c-Hm\o^^m n 11^(011 < Ce(-^»+^+^^)* (42) 
k=o 1=0 

for all t > T and some constant C > 0. Let 

CO t t-l 

i=0 A:=0 1=0 

which in fact exists and is finite according to the inequality (42). Then, let 

OD t t-l 





X 








. y . 



t=o k=o 1=0 ' 
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be the transverse space. For any 



x(0) 



oo fc fc — 1 

:{t) =-^ll c-\p)a'{k) n L{q)y{G). 

k=t p=t q=0 



Noting that there exists T > such that j] |c~^(p)| < e(-^o+')('=-*)+2^* for all 

p=t 

t > T, we have 



T 



a 



k-l 
9=0 



oo k 

k=t p=t 

oo 

< g(-Ao+£)(fc-t)g2efg£fcg(A+€)fc 
fe=t 



|y(o)l| 



< J ^ g(-Ao+A+3e){fc-i) L(A+4e)t < iV/2e(^+^') 



fc=t 



for all t > Tand some constants M2 > 0. So, it can be concluded that 

-1 



lim -log - 1)11 < A + 4e. 

t— >oo t 

Since e is chosen arbitrarily, there exists an m — 1 dimensional subspace = {z = 
[x y]^ : X = — Ylu^Q 111=0 c~^{k)a^ {t) nz=o -^(0?/} of which the largest Lyapunov 
exponent is less than A. The largest Lyapunov exponent of is clearly greater than 
A. Therefore, we conclude that A i.e. log(/5(L)), is the largest Lyapunov exponent 
of L except Aq. The proof is completed. 
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